Skip to content
This repository was archived by the owner on Dec 15, 2025. It is now read-only.

Update code to support newer java versions#586

Open
luisfponce wants to merge 6 commits into
Intel-bigdata:masterfrom
luisfponce:update_code_to_support_newer_java_versions
Open

Update code to support newer java versions#586
luisfponce wants to merge 6 commits into
Intel-bigdata:masterfrom
luisfponce:update_code_to_support_newer_java_versions

Conversation

@luisfponce
Copy link
Copy Markdown

@luisfponce luisfponce commented Jun 5, 2019 •
edited
Loading

Compile HiBench using JDK 1.11 for hadoop 3.2.0 and spark 2.4.0

supporting the following benchmarks:

  • sparkbench
  • hadoopbench

Environment variables: JAVA_HOME=/usr/lib/jvm/java-1.11.0-openjdk/
Compile command: mvn clean package -Psparkbench -Phadoopbench -Dhadoop=3.2 -Dspark=2.4 -Dscala=2.12 -Dexclude-streaming

Log:

[INFO] Reactor Summary:
[INFO] 
[INFO] hibench 7.1-SNAPSHOT ............................... SUCCESS [  0.188 s]
[INFO] hibench-common 7.1-SNAPSHOT ........................ SUCCESS [  5.859 s]
[INFO] HiBench data generation tools 7.1-SNAPSHOT ......... SUCCESS [ 11.859 s]
[INFO] sparkbench 7.1-SNAPSHOT ............................ SUCCESS [  0.014 s]
[INFO] sparkbench-common 7.1-SNAPSHOT ..................... SUCCESS [  7.313 s]
[INFO] sparkbench micro benchmark 7.1-SNAPSHOT ............ SUCCESS [  4.936 s]
[INFO] sparkbench machine learning benchmark 7.1-SNAPSHOT . SUCCESS [  8.397 s]
[INFO] sparkbench-websearch 7.1-SNAPSHOT .................. SUCCESS [  4.023 s]
[INFO] sparkbench-graph 7.1-SNAPSHOT ...................... SUCCESS [  6.131 s]
[INFO] sparkbench-sql 7.1-SNAPSHOT ........................ SUCCESS [  3.402 s]
[INFO] sparkbench project assembly 7.1-SNAPSHOT ........... SUCCESS [  9.242 s]
[INFO] hadoopbench 7.1-SNAPSHOT ........................... SUCCESS [  0.003 s]
[INFO] hadoopbench-sql 7.1-SNAPSHOT ....................... SUCCESS [  2.297 s]
[INFO] mahout 7.1-SNAPSHOT ................................ SUCCESS [  5.024 s]
[INFO] PEGASUS: A Peta-Scale Graph Mining System 2.0-SNAPSHOT SUCCESS [  0.942 s]
[INFO] nutchindexing 7.1-SNAPSHOT ......................... SUCCESS [  4.124 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------

Compile HiBench using JDK 1.8 for hadoop 3.2.0 and spark 2.4.0

supporting the following benchmarks:

  • sparkbench
  • flinkbench
  • hadoopbench
  • stormbench
  • gearpumpbench

Environment variables: JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk/
Compile command: mvn clean package -Dhadoop=3.2 -Dspark=2.4 -Dscala=2.11

Log:

[INFO] Reactor Summary:
[INFO] 
[INFO] hibench 7.1-SNAPSHOT ............................... SUCCESS [  0.149 s]
[INFO] hibench-common 7.1-SNAPSHOT ........................ SUCCESS [  7.683 s]
[INFO] HiBench data generation tools 7.1-SNAPSHOT ......... SUCCESS [ 11.872 s]
[INFO] sparkbench 7.1-SNAPSHOT ............................ SUCCESS [  0.013 s]
[INFO] sparkbench-common 7.1-SNAPSHOT ..................... SUCCESS [  7.477 s]
[INFO] sparkbench micro benchmark 7.1-SNAPSHOT ............ SUCCESS [  5.131 s]
[INFO] sparkbench machine learning benchmark 7.1-SNAPSHOT . SUCCESS [ 10.215 s]
[INFO] sparkbench-websearch 7.1-SNAPSHOT .................. SUCCESS [  3.450 s]
[INFO] sparkbench-graph 7.1-SNAPSHOT ...................... SUCCESS [  7.457 s]
[INFO] sparkbench-sql 7.1-SNAPSHOT ........................ SUCCESS [  3.747 s]
[INFO] sparkbench-streaming 7.1-SNAPSHOT .................. SUCCESS [  5.236 s]
[INFO] sparkbench project assembly 7.1-SNAPSHOT ........... SUCCESS [ 10.339 s]
[INFO] flinkbench 7.1-SNAPSHOT ............................ SUCCESS [  0.003 s]
[INFO] flinkbench-streaming 7.1-SNAPSHOT .................. SUCCESS [  7.554 s]
[INFO] gearpumpbench 7.1-SNAPSHOT ......................... SUCCESS [  0.003 s]
[INFO] gearpumpbench-streaming 7.1-SNAPSHOT ............... SUCCESS [  7.013 s]
[INFO] hadoopbench 7.1-SNAPSHOT ........................... SUCCESS [  0.002 s]
[INFO] hadoopbench-sql 7.1-SNAPSHOT ....................... SUCCESS [  1.663 s]
[INFO] mahout 7.1-SNAPSHOT ................................ SUCCESS [  4.487 s]
[INFO] PEGASUS: A Peta-Scale Graph Mining System 2.0-SNAPSHOT SUCCESS [  0.817 s]
[INFO] nutchindexing 7.1-SNAPSHOT ......................... SUCCESS [  3.344 s]
[INFO] stormbench 7.1-SNAPSHOT ............................ SUCCESS [  0.001 s]
[INFO] stormbench-streaming 7.1-SNAPSHOT .................. SUCCESS [  2.136 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------

Loading
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

2 more reviewers

@gcz2022 gcz2022 gcz2022 left review comments

@carsonwang carsonwang carsonwang left review comments

Reviewers whose approvals may not affect merge requirements

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@luisfponce @carsonwang @gcz2022 @william-wang @sajanraj